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ABSTBACT \ ^ 

\ Five 'PL'ATO exercises on linear ^cision models were 
developed to investigate^ the feasibility of teaching j|aterial from 
operations research on t'he PLATO computer-based eduction system • The 
exercises were administered to business- ^dministratiuatn students 
enrolled in an introdud^ory course in operations research. Each B^TO 
session was monitored to observe student reactions and K^trf oirmanceV 
"afad guestionnaires and an attitude survey were administered, Results 
indicated that it is technically and operatiojtally feasible to teach,' 
subject material in operations research on the ^PLATO systemVbut this 
teaching medium is costly. Students favored thfs teaching meoium and^ 

. learned the- material as well or better on the PLATO system* A sl^rter 
time was involved using the computer than using ttaditioffal teaching ] 
materials. Attributes of opmputer-based systems were a:lso derived.^ 

.* from the study. ' (CH) * ^ , 
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'introduction 



Scope of the Research 



During the academic year 1971-1972, a dissertation project was conducted . - 

to investigate the feasibility of teaching material from an introductory 

" " ■ . ■ • * . • '■ ■ 

course ia operations resear&h op the PLATO III computer-based educatjional 

system of the University of Illinois. Three aspects of the question of . 

feasibility were considered: „ . . ' ' 

1. the tejchnical aspect in terms of the hardware and softwar^ 
which support the PLATO system ^ . * / 

2, the operational aspect In terms of the^catprSSility to develop 
instructioiial material on ^tbe^^lATO/system which could Ije used 
to teach subjegjt^^fiaterial from anoint rocfuctory course i|i operations 




resi 



d bSie'""-' 



3. the economic aspect in terms of the\ costs ajid b^efits of utilizing 
-tmllPLATO system. >^ / | . 

The emphasis in the research was to develop information rea.eva|ht to the - 
operational feasibility of the PLATO system to. teach this typ^ of subject 
material, but the other aspects of feasibilit3/L^were_considere(d-v^^ " 

' 7 ■ ^ 

appropriate. . . ' . 

Throughout the research, various attrituteb of the PLAtO system were 
examined. The irirfjor characteristics of this type of educat'ional system 

•• . • \- ■ ■ - - ' ■ ' ' , ■ •• ■ ■ 

explored in the instruct ipnal material deX^el^oped were: / 

\ • • [ _ 

* 1. the abilit5( to pmvide better individual attention to a student 
thirougii fasiier and\ concurrent responses to student input 
^ ^ 2. the abifity provide a atudent with^^^^ediate|fead1?ack on the 
evaluation of his answeV* ' / * - 



6. 



3. the .■ability to pjpViide the student with the computational power 
of the computer during a lesson ^ - 

<the ability Xo allow a student to work thrdugh a lesson -at his^ 



own pat 

5. the ability to ^^neure that the. student "learns" the cpfrent 

- • - ■■ ' ' ' . - y ■ 

material in a lesson^6^0^^a 1^^ on to subsequent material 

the ^^bfilty to accQmmodat€i\,stu3fent;s witl^ levels of ' *. 

- ■ ' ' ' ■ - -■ • " ' • 'V-' . . / 

competence vV-' T'.' "/ ' * 

7.. th^ ability to present instructional ^^terial in a more consistent 

manner ^- - ' ' *" ./^' • " '/ 

8. the ability to judge student f^^sponses in a broader and more 
accurate manner , . v 

9, the ability to. provide th6 student* with a- variety of visual material 
the ability to j:ollect datg tli^bughout a lesson reg^iirding the 
ti^ttHtife^ and ttndn^^ respoj:ises^ - 

11. the ease iWjISj which a lesson .can be modified.^ 
In addition vtp iny63&4^ting these educational attributes of the PLATO 
systeiittN^fc was attempted to colife<>t information relevant to related questions 
of interest, such ^s: 

1. Would a student's use of the PLATO system to learn operations 
research material instill in film a greater appreciation for the 
N use of the computer and the techniques of operations research in 
^oblem solving? 



2, In which aspects of an Introductory course in operations research 
can computer-assisted instruction be adyantageoiisly utilized? 
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3^ >C^n an a.na.'kfai.s of a student's partlcxlpation In a PLATO lesson < ; • 
V,' ,</*'' • ' * . * .J . 

. -provide- insij^iet into his problem>^solving and decisioa-making . , 

f ^ ' -.^ ' ' ° ■ ■ ' ' ■■ " ^ 

^ processes? * * ' . . - * c . - , 

4, What ar^ the effects of enabling the student to participate ifiore 
actively,^in the teaching-learning -.process? 

5. Hoirwell can^ computer-based educational system^ handle the-Vputine. 
r types.^of teaching responsibilities to* free teachers^to perform' more 

o fmeaningf ul york? < . 



? 



^Methodology 

^ V ' \ ^ \ ' - . \ j . 

In order to investigate this question of feasibility » PLATO exercises 
were developed to treat one of tl?fe primary topics in an introductory course 
in opferartions research, linear dtecjLs|^n models. Initially^ a PLATO^type 
o.f exercise was developed and administered to graduate students in an 
operations research semitiar, BA 474, in the fall of 1971. This exercise 
was a simulation of a PLATO exercise arid was designed to observe how 
^tudervt^^ould react in this type of a learning envirpnment . ^ 

Subsequently, five exercises were developed pn the PLATO system 
arid administered to M.B.A. students who were enrolled in the introductory 
"course^tn Operations research, BA 573, in 'the spring of 1972. The exercises 
were developed to present the Subj|,ect of linear decision models in a 
manner which should be readily comprehended by first yfear M.B.A. students. 

V 

^\A11 the students in BA 573 .were scheduled to attend the first PLATO exer'cise 
to acqu-aint them. with the PLATO system and ati interactive computer 
environment as well as to teach them the subject matter presented in this • 

■ • . ■ ' . ■ '•' 

exercise.' 
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The. next three PLATO dxerqises were administered to contrblled groups 

' ■ - ^ ' I * -. • ^ . .^ .^ 

ot stud6nts\as a hojnewo^k assignment anci. thfe remaining students Were rjequested 

. ■ ■ r ' ^ . ' . \ . , ■ * ■ 

to complete compairable PLATO type' of homework set. Tests .were ^iven to 

examine a student's understanding of the material presented in the PLATO 

' ' ■ ■ ^ ' ■ ' ^ ■ ' A ... 

exercises and homework sets to determine if differences in learning ioyccurrect 
between the PLATO and non-PLATO groups. \ ' / 

. The fifth PLATO exefcise was offered to all the students in BA 573\ This 
exercise was designed to provide the students -with a review of a basic \ 
approach for solving linear programming problem^. The approach had been ^ 
presented previously in lecture-discussions and textual material for tH^ 
course, but the students had -demonstrated a relatively poor ^^understanding 
of this approach on the mid-term examination. Therefore , the fifth PLATO 
exercise was developed to enable students to review this material before 
the final examination was given, \ 

During the implementat!ion of these five PLATO exercises, an effort 
was made to collect as much as possible of the"^-ob jective and subjectlrc data 



ctlve data , 



available concerning a student's perforthaiace in a/^LATO exercise and his 
reaction to this type of teaching medium. In addition taaHministering the^ 
tests mentioned previously, each PLATO session was monitored to observe the 
reactions df students and oata tapes 'were prepared which conta^ed all student 
responses in an exercise, • Questionnaires were distributed to students at the 
.conclusion of each of the first four* PLATO exercises to obtain the 
Students' opinions* of the specific exercise and the PLATO type of teaching 
medium. An attitude survey was distributed to all the student^ in BA 573 ^ 
prior to the completion of the^otirse to collect data relevant to their 
attitudes about computer-assisted instruction and /the capabilities of the 
computer and the techniques or operations research, ^; 

<^ 
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Summary of Results 



Throughout the dissertation project data was 'collected relevant to the 
design and implementation of the PLATO exercises. The significant results 
realized in this project^ will be summarized i1[^ this section and grouped into 
the following categories: , 

1. development of educational material / 
. 2. technical feasibility of the PLATO system 

operational feasibility W the PLATO system 



3. 
5. 



econoiyii^, feasibility of the PLATO system 
indirecjt:, benefits realized. 



Development of Educational Material / ' 

As a result of this research project, five exercises have been . developed 
on the PLATO system which can lire used to complement an Introductory course 
In operations research. Table 1 summarizes the amount of* educational material 
developed and presented in this research effort. / 
^ TABLE 1 ' ' 



Summary .of Educational Material Developed and Presented 



PLATO Exercise 



Session 



1 

3 
4 



2 

.-3 

:'5. 



1 

2 
3 



Students in 
Attendance 

- 43 
15 
10 

13 X 

15 
17 

* 11 
. 32 
,* 11 

10 



Average Lesson 
Time (minutes) 

49.5 . ^ 
, 38.9 

44.2 ' - 
60.7 

, 62.4 
39.3 

40 . 3 \_ 
42. § 
92.6 
95.5 
85.2 . 
97.5 ' 



Student Contract 
Hours 

'. 35.5 
9.7 
' 7.4 
13.2 
5.2 ' ■ • 
9.8 
' 13..4 
9^3 
v49U 
\ 17.5 
15.6 
16.3 
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Tfiusv it. can be tjiat the students in BA. 573 collectivBly worked j>n the 

' . ■ ' i r: ■ . ■ ■ ■ . \ r . \ ; 

PLAtO system approximately 115 hours as a part of this research effort. This 

* * ■ ' ' . ^ ' .• ■ • 

f ' '■■ ■ , ■ . •' • . . 

figure is composed the total student contiact hours on the PLATiO system * 

\ .' ' ■ ■ ' ^ ' 

for each of 'the' fiV& exercises. . . : ■ . 

; \ ■ , : ■ ■ - ■ ■\ , 

The. number of lies son hours of instructional material prepared in this 
researqh is a little more difficult to determine. Table 2 which follows * 
presents the data relevant to the number of thesd hours. 



TABLE 2. 



\ 



Number. of Lesson Hours of Instructional Material in the PLATO Exercises < 

Average Completion Range'of Completion Times (minutes) 

PLATO .Eaeercise Time (minutes) 



1 
2 
3 
4 
5 



totals (plnites) 
totals (hours) 



59,4 
39,,. 3 
40.3 
4:2.9 
92.6 



274,5 
4.6 



Low 


. ■ High 


45 


90 


30 


55 


. 22 / ■ 


59 


28 ^ 


54 


60 


134 


180.5 


' -392. 


3.0 


6.5 



The abovfe data should be interpreted on the tiigh side for several reasons. 

,• . • • " , - * » *• 

First, for each exercise, there was at least one student who did, not complet^ 

who would bjave rdiisejd' the average completion time if -time had .Jseen 
available for him t;^ complete the exercise. Also, the.^times recorded on 
' tape pri^^i^^ow only the times fo^ student responses. Thndj^^^e time^^ 

reported for each exercise are. based on t.he time/until the student's l^st 

■ ■ " ' ' ■ ,- ' ■ ■ . 

response in the exercise. Each exercise conclud^4 with some summary narrative 

<■ *- 
- . • " . / ■ ■■ 

material, so the exercise continued several minutes beyond the student s,^ , 

" ' ' ■ ' ..■ * ft 

last response. An Additional consideration is that the fime 'aldowed for* 

J. ' <* ■ . ■ ^ ^ . ■ . ^ ■ « ^ 

a PLATO e^cercise shoul4 provide for about ten minuted of start-up time to 



acquaint the sttident with the PLATO system and to introduce theXexercTs'e'^lniHt^^ 



•• The five ' lessons. 'developea for* the PLATO system covered onl/part \ 
•o)"the material normally presente4 in an introductoty course operations 
research. In these exercises, "fiiany 'of the basic concepts id the field of 
operakons- rese'arch Were treated ±n-^^ral and thejsub^^r pf linear 
decisioi mode-Is was., pjresehted; in great^er-aetilTr The following list of"' 
fcopics summarizes -tfie specific material presented dn these exercises: 
1 ' K " concepts of a policy, behavior and utility in a decision-making 

situation and 'their representations verbally, symbolically and with 

■ ■. ■ ' ■ ' " ' ■ 

mathematlceil abstractions ,1 ^ ^ 

2. basic - concepts of 'modeling aivd represent^atibns of models with ^ 

algebraic, inner product a/ia^Vector noti^tion 
,3, general ^capabilities of the digital computer . * ' 

4. basic cbnc6pts of vector algebra and vejitor operations such* as 
addition, subtraction and mUltlplic^tiojci < _ 
. 5. basic concepts ot matrix .algebra" with Jn emphasis on dimensioning 

* of ^atrlcfes and matrix multiplication . / 

. ■ • / ' . ' ■ ' . ■ . . 

\ 6. general ^ concepts of ' the .technigtie df ' linear programming with 

.. '■ ' ■■ ■ ■ 

special emphasis on the aapfects of : J _ ; 
" ■. - .■ - ■■ . ^ , , '• ■■' ,■ . ' A " ■ . _ 

• aJ. /the matrix representdtiott of the constraining i^uation Ax - b 

' • ' hJ verlial descripticfri' of the policy ahd behavior s^ces and..):heir 



basis vectors 



V 



c. iterative procedure of searching 'for better alternative policies 
through a change of basis an the j constraining e,^^^ 
7. introduction to the information gei^era^ting eapa^jimies of the 

techniques of modeling and litie'ar algebf a ajid the compute r\wh en use 



together in a decision making situation'. 
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Technlcal Feasibility of the PLATO System- . ^ " ' 

♦ In this research effort, the technical feasibility of the PLATO system* 
was assumed to exist. This technical feasibility is m6asured,^in general, 
by the .capability of the hardware and sof tware available in the PLATO system, 
The^ is no doubt that^nH[^€L.capabl^^ to develop'^'tesson material on 

"the PLATO system and to have students ^li^ract;,, with this material on the^^ ^ 
PLATO system. However, , in view of the author 's' recenF'^exp^^ the 
PLATO system, a few remarks^^iliput the technical 'feasibility of fhis system 
are in order. ' . . » 

In general, the hardware capabilities of the PLATO' system are considered 
ad,equate. The PLATO author and student do not come into direct contact with 
gill the physical components cTf thfe- system, so only the relative items of 
hardware will be commented, upon in this discussion. The primary piece of 

hardware to^ the user of the^ PLATO system id ob'v^iously the terminal.. In 

# . ^ ■ ' /. ■ . ' 

gend^ral, . the terminals used on the PLATO system ^re.good devices for viewing 

information* and for keying ^information into the system. However, these 

\- ^ ^- "" ■ ' ' ' . . ' 

terminals are old and have had^many cootact.hours of use. Cqnaequently , the 

\t ■ ■ . > ^ • ■ ■ . 

viewing screens of the terminals sometimes behaved Jn a manner comparable * 

to the way a picture tube itt an old lil^clc an^ white tel0yijion set does. 

■ ' ♦ ' / / / ^ •'■ V 

There are times, for example, when images fade, ge|t distort jsd, are too dark 

* . •■ ♦ ■ \ /. \ ^ 

or are too light. Tke keys in the keyset may ^tick ^t times,* alsd><^^ 

^ f / ' / . " 

i8*}5elieved that perhaps the terminals are^-not .mairitained as well as they 
shoui-d he since the implementation date of/ the PLATO JV system with its new 

terminSls is imminent. • 

• ■ • / ■ ' . ' » 

^hie other hardware component of- the PLATO system which the user ^is most' 




directly concerned iVith is the'compu 



:J- 1 . . A.t 

Dutefr. 



"During the author's work irt tfeis 
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research effort, tht^e^ere several instances of systems failure attributed to 
the computer when he was workti>g as an author, but none when students weye 
working on exercises on the system. Like the terminals , -i^e computer ip old 
in t6rtns of design and hours of use* It is presumed that /the computer and the^ 
terminals for the PLATO IV system will alleyiate most of these problems 

Vbecause of their newer design ^d improved capabilities. Despite the few 
p rob Xeias'^fen countered with the operation of the hardware for the PLATO HI 
system, ij/is the author's belief that the hardware f ox» th.is system was 

• entirely adecfliate for the preparation of the less oti material and tl^e student 
participatiotii in the exercises developed in this research effort. 

The other major aspect ^bf the PLATO systeip which relates to its 

technical feasibility is the software. In general, the writer considers the 

if 

software for the PLATO system to be very good. The TUTOR language appears to, 
'be a versatiTd and useable compiler level language. Its set of commands provide 
an author with the ability to display and sequence instructional material in ^jj^ 
variety of ways. The author learned to use most of the TUTOR commands and 
has come to appreciate the capabilities of the TUTOR language.^ There are 
undoubtedly other uses of the TUTOR commands which the writer is unfamiliar 
with which cian be us^ to present instructional material more effectively and 
efficieitly. ^However, if^as been the writer's experience that one does not 
become highly prof icient *in the use of a programiAing language .until he has 
had several years of solicl experience wlths the langu^ige. . ~*. 

The\ TUTOR language was developedjSpecif ical\y f or the PLATO computer- 
-based educational system. ItsVset oH commands were designed especially to 
display instructional material, sequence Instructional material and evaluate 
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responses. Therefore, it is the writer's opinion that in developing lesson 
material for a computer-based system it would be more efficient and effective 
to use a specially designed language such. as TUTOR than commercially 
available languages such as FORTRAN. This indeed must "have been the thinking 
of Plato's technical staff since TUTOR was designed to replace FORTRAN as 

X. ' ' 

the primary user language on t^e PLATO system back in 1967. 

However, in the development of the PLATO exercises for thl8 r^^earStT 
effort," there were some aspects of the TUTOR language idviiarcaused problems. 
Specifically, the available commands to bjuiitf^micomplicated response Judging 
routines for verbal answers did riot appear to be entirely adequate. The 
biggest fault appeared to be the judging of cOrrfect student answers as ln7 
cijrrect. It is primarily the author's responsibility,. to designate the 
acceptably responses for a question, but it becomes quite a islzeable and 
complex task to designate for every acceptable word that, say, its plural 
form and all reasonable synonyms are acceptable, also. If commands could be 
developed which allowed the judging for verbal responses to be more flexible, 
then TUTOR would be an even better user language. 

The other major aspect of the software of the PLATO system which a 

user frequently comes in* contact with , although indirectly, is the operating 

syst.^mv'"""'^fhis set of programs allows an author to gp from author mode where 

he develops new lesson material or modifies existing lessbn material to 

student mode where he can interact with the lesson material. In this 

respect, the operating system for PLATO appears to be excellent. Existing 

TUTOR programs can be revised in a very expeditious manner/ Irt the author 

mode, the set of commands for the program is viewed. By the use of very s 

simple. procedures , a command can be deleted, revised or replaced or additional 

\ 

^ A ■ ' ■ \ 




commands can be added Co the program. Thea^ an author can go dirgctly to 
student mode atfd test the changed pirograta*. This interactive type of program 
modification, makes the* use o| an author's time, much more efficient than if 
program changes had tg ¥e made through some typ^ of batch processing system. 

The above ^:rdmarks were intended to substantiate the assumption tha^ the * 
PLATO system is considered technically feasible as a medium for developing 

ediKlational material and presenting this material to students. The hardware / 

- ' • . . * * ■ .' 

and the sdftwigire for PLATO III is quite useable and it is anticipated that , 

components of PLATO IV will have even improved technical characteristics. 

operational Feasibility of the PLATO System ^4 

1. Introduction ^ f^^^^^ 

The major question to be answered ^in this research effort was could 
the PLATO system be used to teach material from introductory course in 
operations research. Throughout the research , various ways were used to 
collect data relevant to this question. Several methods to collect object^l^ / 
data were attempted, such as , tape prints of student responses during a PLATO 
exercis.e,^ graded homework sets for the non-PLATO students and tests administered 
to all the students over the subject material presented in the PtATO and 
homework exercises. Various ways were used to collect subjective data, also, 
such as questionnaires, attitude surveys, observations of students during a 
PLATO 'exercise and personal discussions with students. The' resultp of the 
data collected relevant to the operational feasibility of the PLATO system 
will be summarized in the succeeding sections of this report in terms of the 
objective results and the subjective results. 



2. Objective Results/ • 

The objective results realized in this' study rega^rding the opetd^tlonal 

feasibility of the PLATO system to teach material from an introductory course 

' . , * ' * • 

in^o^erations research, wl^l be suntmarized in terms of:» . 

1^ the test scored realized in PLATO related teats by students participating 
In the PLATO exet'cisies contrasted to the test scdres attained' by the • 
stud<fents who did not participate ^in the PLATO exercises' 

2.* length of tioe' necessary to complete a PLATO' exercise in contrast 
\ to the length of .time necessary tb complete a comparable homework 

/ exercise. . - ' . 

• ■ ••" ■ " . . ' 

The ^results in this research indicate that^ the students who parjticipated 



in a PLATO exercise scored higher , in ge 



in the related te^t than did 



students who did not participate in the relevant PLATO i^xerclsB. TABLE 
3 stunm^rizes the results realized in these tests. 



TABLE 3 





, Summary 


of Results «of PLATO Tests 
* • > 








• PLATO 


non-PLATO 




PLATO Test . 


Question 


Group 


< Group 


Other 


1 




87.8 


80.4 


82.2 




1 • 


21.5 


20.4 


19.7^. 




2 


48.7 


39.1 






3 


17.7 




^ 28.3 


2 . ' 




83.9 


^ 


91.5 


3 




87.9 




69.8 






46.8 


43.0 . 






1 


11.2 


11.1 






" 2 


10.3 


7.4 






3 


12.4 


10.9 






4 


- 7.3 


9.8 






5 


5.6 


3.9 
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PLATO Test I wa^ deaigned tp test.^ttie studelats onNthe material covered 

• . . ■ - ' \ ' ' • - ^\ . 

in PLATO ^x6rciae 2' and its 'rej^ed homework set, to test l^he students on 

" • ' ' ' ■ * \ 

thetr ability to exten^tfte con^^^ in these exercises and to 

test the studej^ttf^ formulate and solve a linear decision 

l^robl^^i^-^ueattptt 2 on this test was the question designed to.jspecif^cally 

^x6vex the material presented in the homework exercises, so the results on^this^ 
qjuesTion mbst directly relate to the question of the operatios«rfr?easibility 
of the PLATO system. The students in the PLAT^^I^Iroup scored on the average 
about 24 percent higher onVtV^is-'^'tjflie^^ than did the students who did th6 
comparable^jiogp/or^^ and aboOt 42, percent bettjer than the students who 

^^j^&tticipated in neither exercise. Furthermore, a statistical interpretation 
ol these results indicates that a t-test of the difference of the mean 
score on question 2 by the PLATO group arid the mean score on this question by 
the non-PLATO group signifies that the probability of this difference occurring 
by chance was between .02 ahd .04.' Tliis t-test was conducted using a standard 
.deviation of 3.52 for the ^scores of the PLATO group on question 2, a 
standard deviation of 14.5 for the non-PLATO group and 45 degrees of freedom. 

Question 1 on test' 1 was designed to test* how w§ll the studenf under- 
stood the material presented in the homework exercises and/^could extend the 
use of this material based on other material previously presented in class- 
room lecture-discussions. On this question, the students in the PLATO group 
scored only slightly better than the other students did. It was observed that 
on question 3 in this test, the students in the PLATO group^ scored noticeably , 

"^Qwer than the students in the other groups did. This que&tion required the 
"students to formulate and solve^a lineat" decision problem and was considered 
the most difficult questiqp^on the test. Therefore ,* it could be inferred 
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that since the students in the PLATO group scored lower^xuv-thla cfuestion 
than the other students did, theij^^M±lty^t^^ Operations 
research mat ejciaJsiT^n^ general, was less than that of the other students, the 

Cnal course girades aSihieved by^-tfie^studentft in BA 573 support the claim 
that the PLATO group^f^tudents in this exercise^ had a lower ability to 
perform in^tjiifi courjse than the 'other students did. This rTnitial PL 
group^^cpntained about 28 percent of the students who were^enr^^ In BA 573 
at the time, but 75 percent' of the students who eventually, dropped this 
course were in this group and only 13 percent o£ the students who received 
A's in BA 573 were in this group. In summary, the results on PLATO Test 1 
strongly indicate} that the PMATO system has the ability to teach material^ 
front an inttoductory course in operation^ r^searc^* It appears \(hat 
students with a lower aptitude for operations research learned this subject 
material better in a PLATO exercise than the other students did in the related 
homework set or by studying other material on th^lr own. 

PLATO Test 2 was designed to test the student s knowledge of the material 
presented in PLATO exercise 3 and its related homework set directly. An 
attempt was made to/^evelop a test which closely covered the material presented 
in these exercises and which would indicate a student's understanding of that 
material. As Table 3 indicates, the students in the |*LATO group on th^^ 
average had about 3 percent higher scores on this test than jdid the students 
in the non-PLATO group which completed the ^bmewojckrexercise.* The fa<^t 
that the students in the "other" group score<i higher should be discounted 



77- >• 



*lifee;^-t-test of the^ difference of the mean score of the PLATO jgroup on this 
test and the mean score of the non-PLATO group indicates thdt the probability 
of this diff^encB occurring by chance is between .8 and 1. ^ This test 
was b^ed on a. stimdard deviation of 8.3 for the PLATO group and 12.3 for 
the lu^n-PLA^ group and upon 46 degrees of freedom. 



since there wejpe only two students in this group, one who stated he completed 
the homework exercise but lost it* ahd another student whose background was 



so strong in this type of m||erial he felV he did\ot^need to prepare 



for the 



test. Thus, the strongest st^ement which cari^ be mai(e- basect. on this test is 

that it tends to indicate that when this speci^^ic type of material was 

' ' ■ ^ \ , ■ ■ 

ptesenfed in a PLATO exepcise and a comparable homework exercise, the students 

in the PLATO group demonstrated on to appropiate^ test that th^ learned the 

subject . material as well or better as the students who did not participate in 

the PLi^TO exercise did. 

PLATO Test 3 was designed in much the same mjinner that test 2*waS>. The 

test was developed to examine the students on the material presented in 

^ PLAT^ ekercise 4 and its related homework set in k straightforward fashion. 
The results in Table 3 indic^^e^tfiat the students in the PLATO group did 
well on this test ^.btrf^ot as well as the group, who completed the homework 

analysis of the studen^s^^n^.iiie^^^^^ wllich completed the homework 
set d|j.sclosed that Jth±^^roup contained about 64 percent of the students who 
3Pok-'tfie test, 69 percent of the students who received A's in BA 573, 
63 percent of the students who t'iceived B'g and none of the students who 
received C's. So, t^^^n^-PLATO group for this test appeared to have a 
higher percentage/^ the better students in it and i^t appears these students 

^-^re able to learn this subject n^aterial as well or better on a homework 
exercise than the other students did on_a PLATO exercisotuxr by other means. 
Nevertheless, th^ results* on this test, also, tend* to ;indicat?e^ t^Kat 
students can learn this type of material through exercises developed for 
the PLATO system. Moreover, the -results siuggest thut for the type of 
material presented in PLATO exercise 4 a well structured homework exercise 
was also a Y®^y good teaching instrument. ' 



/ 



/ 
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Th^ fo^tth test lisfSd in this research was the final examination for, 
BA 573. This test was designed to examine students on their knowledge of 
.definitions and p^roblem- formulations and solutions overr the entire range of 
material presented in BA 573 during tlxe semester. Therefore, only questions 
3 and 4 orf*this test related^directly to the material presented in PLATO 
exercise 5* Question 3 basically required the students to identify alternative 
solutions in, a linear programming problem throu^gh^the.fih^ge of Jiasis^ _ 
cedure. This question"^ was designed to examine the student very closely on 
the material presented in PLATO exercisJ^S. The results on this qu^st^on as 
depicted in Table 3 show that students in the PLATO group off the average 
received about 14 percent hi^er^cores than did the students in the non- 
PLATO group* Furthermore, when the' results^acltiev^d^^j^ these groups of - 
studenfc^on this question are contrasted with the scores^ac&tevgd by the 
same groups of students on the prior question concerning the solution^ 



linear programming problem on PLATO Test 1, the results^ttained by the 
PLATO group on this question on the final examination are even more impressive. 
Table 4 which follows summarizes the performance of these groups of students " 
on the two test questions which related to the formulation and' solution of a 
linear programming problem, • . - 

TABLE 4 - ^ 



Summary of Performance on Linear Programming Probletais # 



Group 

PLATO 
non-PLATO 



Students 

32 
17 



PLATO Test 1 
Ques tion 3 

27.9 




lestlbn 3 



12.4 
10.9 



These results tend,;,t©-Suggest^ th^t without: the benefit of participating in 
a'PL^X0--'gxercise which presented th6 general, concepts of Tinear progifammin^ 



V ■ 
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the PLATO group averaged* scores only 67 percent as high as those in the nor\r 
PLATO group on a test question concerning tdie formulation and. solution of a . 
'linear, programming problem.* After participating in a PLATO exeraise which 
covered the concepts of linear programming, the PLATO group on the average 
made 14 perctent higher scores than the non-PLATO group did on anothey test 
question regarding th^v^orj^ilation and solution of a linear programming 
problem.** 

/ Question 4 on the final examindtiorf^ BA 573 required the. students to 
formulate the problem^ presented symbolic ally^S; an optiriiiz^tion problem and 
to identify a set of basis vectors- f ot each flttlte dimensional vector space 
U3ed. This problem was an adaptation of a protjdem assigned as homework 
during the semester whicfi the studeiits 'fpund very difficult to solve. ^ 

i ■ •-■ . ■ - ■ , ■ 

PLATO exercise' 5 would not have directly prepared a student t9 answer 
' ■ -^.i. , ,. ■ ■ • 

question 4 on ^iie -final examination. Rather, if a student, fully understood 

the concepts of linear programming as presented in PLATO exercise 5 and 

could extend this type efj£ reasoning to. a more complex problem, he "would. 

Kdve done well on question ^ - An agi a lysis, of the individual grades on this ' , 

question showed that one-half 016) of the stWnts in ^the PLATO group 

scored five or less >poii(ts on this question and\only two people in the 

non-PLATO group scored Vi^e or less points on the question. These sixteen 



people in the PLAXp group averaged 10.5 points. onr q^iestion 3 while the two 

• . . :H ' 

*The t-test of the difference of the .ifiean.,s core o^^:'J'LATO |roup on this 
test question and the mean score of the non-PLATO ^oup indicates tha^ the^ 
probability of this difference occurring by chance Is between .04 and .10. 
This test was based on a standard deviation of 12.5 for • tlxe PLATO group / 
and 15.5 for the non-PLATO group and upan 47Megrees of freedom. , 

**The t-test of the difference of the megn'score of the; PLATO group- on . this 
test question and the mean- score of the non-PLATO group indicates thatthe 
probability 'o> this dj.fference occurring by chance is between .8 axA^ 
This tesi^s base'd on a ddandard deviation of ^.5 for the Pl^^^oup and 
7,1 fcHT^e- non-PLATO grou/ and upon 47 degrees of freedom^ 



people in the non-PLATO group whp scored five or less points on question 4 
averaged only 3.0 points on question 3. . This analysis tends to indicate 
that this PJ-ATO group of students learned the b^sic material in PLATO 
exercise 5 well as evidenced by their scores on question 3, but did not 
have the ability to extend this type^ of/ thinking and perform we];l on 
question 4. These results are summarized in Table 5 ^In te'rms «of the average 
scores received on questions 3 and 4 by t;he students /who received a, score 
of ,ffve or less poiji1:s on question 4 of the final- examination. 
' «^ ^ TABLE 5 

Analysis of Students Receiving Low.. Scores - ^ j 

on Question 4 of PLATO Test 4 \ V , 

Group Students i Question 4 ^ ^ \ Qi^estidn 3 

PLATO " 16 ' . V 2.6 ' 10. S • > . ' 

' non^^LATO 2 2.0 . 3.0 

The results on this test, also, serv^^o Suppprt the conclusion that it is, ■ 

.operationally feasible to teach materialTf^m^an introductory cou'^se in 

operations research on the PLATO system./ In gerier:^l, it cmi be inferred from 

the results on this test that the stu^e^ts^ who participated in PLATO exercise 

5 did not know the basic concep|:s of li^riear programming as well as the non- 

PLATOt^ group before the ekercise, but that they understood thes^' concepts : 

\ * / ■ • * • '" 

better than the non^^PLATQ group after/ the exercise. It appears that fLATO \ 

exercise 5 was effective In presentii;/g some of the ba^lc concepts of the 

A. . ■ • ■ ^" ■ ■ ■ • , 

technique of linear programming. Fu'rthermpre, the^ir^sults In Table 5 ■ 

suggest that even students in .the PLATO group who' did very poorly on 

' ■ , ■ " ■ « . 

question 4 oh. this test, indicatjlng that they ^id not have a sound under- 
standing of the technique t)f linear programming, were able to score fairly 



eii on question 3 exhibiting that they understood some of the' basic concepts 
ot; linear /pra$rainjiang after they had completed" PLATO exercise 5. 

In summary^ the tests •'administered in this research have indicated "that 
Students who pA^^t^adpate in PLAT!© exercises le^m the matetial! wkll which 
is pTresehted in these exercises as demonstrated by )thed,r scores on tfi^ . 
related tests. In most instances » it was seen that these students scor^d^ 
better on the related tests than the students who completed the .;bl4tti^yot^k/ I, 
exercise or ui'ed spther meians' to prepare' fo;c the test^i> Perhaps pne -i^^^ 
foup this better performance by PLaJO ^tud^nts was the level of -CQii^^ct -y ' • . 
information which a^ student had when he completed a PLATQ -Or: :l\omewq|^ 
ejtercise. With the PLATO exercises, , a S:i;ud.ent was r^Uire^ fe0 
answer beiore proceeding with the lielst qwsst4<*v ; 
completing a^^LATO exercilse was aw^re o£:^ith4 :,cotte^^:^3^^ 
question asked in the exercise* In fact, he .phySidUij^. ^i^^^^^^^^^^^ 
corr6ct answer into the system to move through fch^ ^jcejtC'ilsJe^fe M l's^^^^ 

to this, students who completed the hdinewbrk ^ekerciaes wr^fc^^-i^^^ 

• • ' . \ ■ ■ ' v,iS';/^''',7V';/'. • ■ '''r/'' '\1VV^^ 

answers, had their answers gradiad and determined the cdirrejc^;? 4TjL^]«et;^^^ 

questions tnarked wrong ikly if thfey so desired. There »was :|lo,vf# 1^^^ ^^te^inii^^ 

yhether students in the homework exert ise groups in 'fact reviewed their,, ' 

, giraded Tiomewo^rk arid corrected wrong'^nswers so that they were aw^re of the .;v(^ 

correct answers to homework questions before they .took the related' test^av ■ ^ \ 

' ' \ ' ' ' ' '"\ 

Table 6 which follows summarizes the stuldent's awareness of the ^^rect 

information whten he had completed either' the PLATO exercise or the re],ated . ^ 

homewdrk assignment f6r tlje three PLATO fexercises where cdmparable. homework 

'sets were developed. The percent correct was computed by dividing the • \ * 

\* ' ' ' ' ' • ' ' ' 

■ tStal correct responses entered for an exercise \>y the total responses ^ 

.\:' . • ■ - , . ■ ^ ■ . . . ■ • 

»>. ^ ' » • . . ^ • 

required. " ' ^ - 



TABLE 6 * ' , 

■ ^ ■ '• ■ \' - ■ 

Sunnnary of Homework Performance 

/ * ' ■ . ' ^ •■ ' • " ' 

PLATO PLATO Exercise Group Homework^/Exerciae -Group • 

■Exercise % Correct Time (minutes) ' % Correct - Time (minutes) 

« • • ■ ^ f' , . 

2 : 99.2- 39.3 • 80.0 . 53.6 

3 98.5 " 40.3 • 83.0 28*7 ' 

4 97.3 42.9 ' 82.3 71.0 

,The results depicted in Table 6 suggest that students in t^e. PlfAlfO group 
could have performed better on the related tests because the/ h^ greater 
knowledge of the correct infoj^ation when they completed' an ^ercise. 

Table 6 also presents tSi^ information developed relevajit to; the average. 

time required to complete a PLATO or homework exercise, it is contended 

• . . ■'■ < . • ■ . / . ' . 

that the length of time required to cdmplete an exercise /relates directly 

•. - * ' ^ ' • . ■■ ■ . ' . / 

to th^ of)etational feasibility of the t»LATO system. A' discussion' of tha 

^average time required to' -complete each of the ei^erclseyS identified l,n 

Table 6 follows. , 

PLATO exercise ^2 was a relatively straightforward lesson, but an analysis 

■ ^ - ' - \ ^ ' ■■ ^ ■ \ ■ * ' 

of the t^pe print for Jmis exercise indicates it caused ,the students some 

• ••'* • ' " " , ' 

difficulty because of the ^confusiorl surrounding the fill^-in-the-blanfes^ type 

' • ■ - ■ *' ' • ' J 

questions and -the routine used to calculate the value of the student-^year* 

^end portfolio. 'This calculating routine was not meant to sa«he,a student time 
in this "relatively simple problem, but rather* w^s us^ to deL(^nS;trate the ^ 
computjst^ional capabilities of the PLATO system. In fact^ the value of the 
year-end portfolio could probably have; been calculated<. jus,t as quickly by 
hand. Nevertheless, the results indicate that on the aVerage the students 
required only about 73 percent as much time' to complete the -PLATO exercise 

•as they did to comple^te the co^arable hotaework- exercise. As indicated. 



this group of students appeared to be -lower in ability than the other ' 
students, but they scored higher oh. the related test . So-, the presumption , 
can be made that for this gr^u^^^^^^^^ abiJLity in operations 

research, the PLATO exercise prepared thetti- better for the related test in 
a lesser amount of time than the homeWork assignment prepared the other* 
group of studfentsi whO /^gifppeared to have more ability in operations research. 

PLATO exercise 3 was- developed as an introjiuctiori to matrix algebra 
and matrix bperratibns. It contained a routine which cpuld be called by the 
student to perform the necessary wctor^ multiplications • Table 6 indicates 
that, on the average, students required 40 percent longer to , complete the , 
PLATO exercise than to complete the tomparable homework exercise,' The tape 
print for this exercise and at summary of the results of the hom6^ork exercise 
were analyzed to determine Why . the PLATO exercise required more time than 
the homework exercise. The fbllowing aspects of PLATO exercise 3 were dis— . 
covered to be the major reasons why the exercise was not completed in less time, 

1. Students averaged over five minutes on the lead in question which 
a$ked "What type of information i:s necessary to' determine capacity?" becaws^ 
the response judging routine was n<at flexible enough, but on the homework 
exercise any reasonable item of information was accepted -as a correct . answer 
for this question/ For this question, there were 68 incorrect responses in 
»the PLATO exercise and only four incWrect responses in the homework set, 

2. A question which asked what me app^opriatie vectors were to compui^ 

the capacity used; in a processing operation required their names and some 

'Students entered the numeric representation of the vectors instead. The 

PLATO exercise would not accept the i;>umeric representation, so there were ' 

* ■■ ' \. k ' ' - , • 

132 incorrect responses on. this exercise for this question and students 



V 



required an average of almost sik minute#-^; ^ap^^ 
^Tp the contrary , overd one-half the stiuSi^g^^^^t^ 
answered the ciuesfion with the numer^^ repr^fe^^^^ 

given full predit for .the "••t-r/v'^^^^u^-^*^^ • 



• •'..4 



were 

' 3. The exact definiti 



.on for^ /matrix ^Itiplid^ 
«t^l^ts found it'difticult to enter the pre^ise^^ 
* incorrect responses to this questtdrt .^nd the ^avera 
ten and x>he-half minutes to enter the correct aiiswetvv Ovet oiie--hai^ the ; - 
studfmts' who completed the homework /exercise aisp missed this qUestion^^^^ 1^ 

were njpt required to spend the additional time n^cessaiy tp. develop the 

* * ' * * \ ' ^ ■ ' ' • ■ \ * * / 

/ V -correct answer which a PLAtO .''exercise requires, \ 

4. The* average student required about six minutes i:o "use the vector 



multiplication routine developed for this exercise and since this was a 
relatively simple examplq, the computation could probably' have been done 
faster by . hand. In> addition, five students did not. ,b<^ther to compute the 
answer req.Mired in the vector multiplication question in the homework ^ 

! ♦ ' ' ^ ■ , ■■ ' .. 

exercise, so their times to complete this exercise would be expected to 

be lower. ^-.^-.-^ . . — 

' - Nevertheless; the. PLATO group for PLATO exercise 3 did perform btetter^/" 



^th§n the non-PLATO group in the related test. Even though the PLATO group 
required longer t6 complete the exercise than the notl-PlATO group did, there 
were extenuating cii;;cumstances. The PLATO exercise required more precise 



PLATO 



*'answeVd and^was used to illustrate the \pn(putational power ,of the ^ 
♦ • system/ so this exer^|j.s4 understandably took more time for a student- to 

'/ • — / ■ ■ / ' ' ° ' , ' . ■ ' ^' 

'i complete than the associated homework exercise. 




0 



ERLC 



26 



PLATO exercise 4 was developed to extend the student •s knowledge of 
matrix operations • In this exercise, a routine was developed which performed 
three vectar-mattix multiplications and a subtraction to compute profit. 
Qnce the student ha^ set up/the matrix representration of the profit equation,. 



he could call this rqut^e to perform the necessary calculations. Th\i8, the 



andwer^ requestec^ in this exercise required more complex calculations than 
were required in i^he prior exer<;ise; so the compii^ter^ routine,* in PLATO 
exercise, 4 was not-pnly illustrative^ of the computational power of the 



PLATO system/ but it ^as.a much faster way«to perform the necessary c^l- ^ 
culations than by han^. So, on thfe average, the>tudents in the PLATO^ group \ 



required only 60 perceiit as. much time as the students in the non-PLATO 
group to complete, this Wxerctse. Therefore, the^nference can be dratm 
from the results relat^*^ to PLATO exercise 4^ that the PLATO group of I ^ 
stu^nts learned the subject material almost as well as the non-PLATO group 
did in considerably less time. . j 

I/t is realized that the objective results attained in this research ^ 



effc|rt must be put into proper perspective. An attempt has bpen madja to 

rational manner based on rkasonafc^le assumptions,^ 
relevant to the PLATO ekercis^* and the 



interpret thpse results in a 
but' there is 



homework ass 



much information 

ignments which ii unknown. The questions |listed||below are the 
kind which need answering I to be certain tjhat tke resu^.ts reiliz^d in this 



\ 



research are truly objective indicators of t^e operational feasibility of 
fhe^LATO system. , , ' • I 

l.» Did the student^ actually learn the jnaterial presten&d in the 
pLaTO exercises or^didi the exercijds merely motivate thera/ to Wudy oth^r 



-24- 

material better before the test? 

1. How much of a disadvantage was It to the PLATO stiudents not to 
havie a graded homework exercise to review before the test? 
r 3» How accurat^ljj: did the students report their y^lmes required to 
complete the homework exercise? , ' 

.4» What was the effect* on the tesults that some students received 
and gave assistance on the homework exercises? 

5» What was j^he ef fecc on the results of the author'^ Inexperience * 
with the PLATO system and the TUTOR language In .developing effective PLATO 
exerclgeQ^ especially the Initial ones? . * . 

The objective results presented In this section were based on the 



^assumptlohs that a P^LATO exercise and 



Its related homework exercise 



I \ presented GX>mparable educational matetlal, that the related tests did a\ 
provide a good measure of a student's understanding of the material presented 

) 

In these exercises and that the homewc^k exeijclses and the tests were graded 
In a *falr aiid consistent manner, ii^^txi respedt to these assumpjtlons and 
all that is known about t|;he Objective Results in this research, it should 
be stated that the evidence indicates chat lit is operationally feasible 
j to teach material from 'an introductoij^l course :.n operations r^isearch on the v \ 
I PL^O systism. Furthermote, the resultM sugees : that most studEnts learn 



certain types of m^erial better and fiisteii on the' PLATO system tha^n by the 
more traditional means of in8tri|fctton» / 



!• Subject lye Results w i " / 

A^ has been indicatedf an extensive/ effort was made in this research 
effort to collect the objective data /relevant to the question of th^ operational 
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feasibility of teaching material from an Introductory course in operations 
research on the PLATO system. Furthermore, the students who participated in 
th'j^^esearch effort werej^^^ed their opinion of the feasibility of teaching 
this type of material on th6 PLATO system £n qi;der to collect subjective 
information relevant to this question, also* Questionnaires were distributed 
to the students who participated in each* of the first four PLATO, exercises 
and an attitude survey was distributed to all ^he students in BA 573 at 
the end of the coiirse. In addition, each PLATO^session provided the author 
with 4n opportunity to observe the students', reactions td,the\BLATO system 
and- to discuss with students various aspects of this teaching mifedium. There- 
fore, written comments, observations and discussions form the basis for the 
presentation of the subjective results of this research. 

The ''comments to the iquestionnaires which were completed by the s'niidents 
after the PLATO exerc^ises have been summarized and included as Appendices 
A, B, C and D. It can be observed that the majority ef the situdentte who 
returned questionnaires were positive (in their ^rem^rks concerning 
PLATO , system as a teaching medium. S6me of the more significa nt cj tymierits made 
by the students are included below: 

! ■ . ^ i ■ ' - . 

1. It causes j3ie to Ifearn faster because of the feedback*, 

2. My impressions arib entirely positive., I like to learn at ny 
^ own speed and havj^ immediate feedback. 

3. It'^ easier to learn concepts this way, 

4. This method is much better than classroom present^tijons since the 
material ifi easier to follow. ' I m 

5. fhis exercise was more interesting than the conventional type of 

< , " • . / - ^ • ■ 

homework. ' - 
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6» This method jsrovides greatei; personal involvement and greater 

demands placed on learning. ^ « 

7. This exercise was very helpful and practical. I am impressed 
with this type of teaching procedure. . \ ^ 
These types of comments emphasize the students' appreciation for some of 
the unique charactffristics of this type o£ teaching medium. 

Furthermore y the comments made 'on the attitude survey which have been 
summarized in Appendix E support the belief that it is operafiqnally 

feasible to teach material from an introductory course in operations research 

• » ' * ■ ■ 

on the PLATO syjjtem. In response to tHe question on this survey » "What 

teaching techniques used i/i this course have been the most effective in 

your opinion?" . seventeen of the ' forty-two students wiio responded to this 

question answered "PLATO". Eleven ^typfes, of teaching techniques were named 

by the students in answer to this qtfestion and the techniques named th^ 

it often besides I PtATO were "computer work" by «even students and "class 

pbobJLems" by si^jc stludentB. ,So, moi:e students in BA 573 considered PLATO 



be the most effejctlvl^ teaching technique used in this coursie than any 

1 • - ■ . ^ . , ^ ^ ^ ■, «^ - 

(l»0he|r technique. , 

i'; y ^, 

In addition, the majority of the respons^ to the question on .this 



{burvey, "What, is your general impression of the PLATO system as a teaching 
'technique?" alsb supported t;he"oB^rational feasibility of the PLATO system. 
Forty-vone students marked their^i^mpc^^ of the PLATO system on the attitude 



cale provided for this question which ranged from unfavorable to ;very 



favorable. The average ^ranking was dioi^iiuted to be very near the favorable 
position on the sc^'^C Al^o, th^ ma^ni^y of the written coniments to 'this 



question were complimentary to the PLATO system as a teaching technique. 

Only three of the forty-one students who responded to this question considered 

PLATO an unfavorable teaching technique. < 

The other question on this survey which related directly to the operational 
feasibility of the PLATO system Was ''What recommendations would jyou make 
"tor using PLATO type instruction in future BA' 573 courses?" Students 
interpreted the intent of this question differently. They considered it 
tx) mean how much PLATO instruction shouid'be used in the= course or to 
what aspects of the course should PLATO be applied or how should the 
development and implementation of PLi^^TO exercises be improved. Whichever 
way the student Interpreted the question, his response was favorable to 
the PLATO system in general. The studeht^ who interpreted the question 
to mea^n how much PLATO instruction should be used in BA 573 made the comiflents 
which related most directly to their opinion about the operational.:feasibility 
of the PLATO system as a teaching techniqijie. Twenty-six students made 
comments which reflected they interpreted the question to have this meaning. 
Of thfese jComments, twenty-thjee were positive and three negative toward the 

continued use of PLATO exercises in BA 573. The relevant comments extracted 

■1.- 

fronf those , listed for this question in Appendix are: 

1. increase its use (11 students) :^ 

2. use it right from the beginning of the pourse (6 students) ' 

3. continue to use it (3 students) 

4. use it as much as possible <3 students) 
, 5. none (1 student) ^ . 

6. drop it (1 student) ^ ; 

7. prefer an instructor (1 student) 

Thu^s^.mos^t oic the relevant informfeition provided on the attitude survey 
indicates that t.he students in, BA 573 found, the ^LATO system to be an 
effective and desirable teaching medium. 
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As indicated previously, the students were observed durlriR each 
PLATOa exercise and numerous^conversatlons were held with them throughout 
the semester to better determine their reactions to the PLATO system. 

* 0 

From the' Initial ifLATO exercise, the writer received the impression that the 

V \ ' ^ * 

students considered the PLATO exercises worthwhile learning Experiences. 

• \ ' . - 

in the beginning exdrcise^, the students did express some frustration 
they did not\ believe some of th^ questions and directions were clear enough 
and because they thought that some of the response judging routines should 
have been made more flexible. ^However,, as the. writer gained experience on 
the PIATO systeB^.an4 with the TUTOR language, the ^reactions of the students 

\ ' ^ ^ ' ' 

-tieemed to indicate thatD eapK succeeding exercise, was an Improvement in 
terms of the conteii^t of the niaterial and the way in which the mat^gial was 
presented, FurthenJiore'» at the conclusion of PLATO exercjLse 5, man^ studentis 
commented that they liked tiie exercise and considered it a vety good learning 
experience since it ^gethe^ many of l:he concepts of linear prpgraiftnaing 

■ - A ■ . ■ • ■ ■ . . < 

Thus, it iff believed \that the ojijijej^ive results and the subjective 



results for this research ske compatible. "These results strongly suggest 

that It la operationally feaddble to tpach material from an introductory 

course *iW operations research ^^ncfee^^ATO system. . 

* \ 

. ' / 

t Economtc Feasibility of the PLATO^ 

Although the p^rlmary purpose olf this resparch effort was to develop 
relev^t information to determin* diaqpeirationdl feasibility of teaching 
material from an introductory course in operatiotis research on the PLATO 
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system, .some information relevant to the economic feasibility of the PLATO 
sj^sCem was collected. The determination of the economic feasibility of a . 
systemria based upon a ^determination of the costs and the b0nefit8 of. the 
system. Th^ costs of the system can normally be divided into the develop- 
mental or one time/ costs and the recurring or maintenance costs.- The 
developmental costs associated ^,with the preparation of exercises for the 
PLATO system are'basicaliy a function of an author's experience with the 
PLATO system and the TUTOR language, his familiarity with the subject -material 
jto be presented in the exercises^ and the type of educational strategies to-be 
used in the exercise. These developmental costs are generally in terms of the 
time an author requires to develop an^ exercise and the time the PLATO system 
jf.s requited in the development of an Exercise. 

In the development of an exercise, an author spenlds his time laying out 

t^e content of the lesson, prt)graraming the lesson material at the PLATO 
i . . " -* I ■ * ■ . . 

terminal, testing the material the PLATO terminal ai« making suitable 

inc^difications to the program through the PLATO terminal. At the PLATO 

laboratory, different authors cWi be observed programming lesson material 

straight from textbooks, from notes or witjiout reference fco any material at 

all. Tills Author wrote narratives which substantially jputlined the material' 

to be included in a PLATO exercise. No detailed recordfe were kept during 

this research as to how time was allocated,, so no objective statdtaents can 

be made as to how much time it required the author to divelop eachvPLATO ^. 

exercise. However, by referring to Table 7 an estiniate can be made/ of the 

* time required by the author to develop PLATO exercises fbr the coi^rse 

^material presented in BA 573. 



PLATO Exercise 

1 
2 
3 
4 

5 ' 



TABLE 7 . 

.Implementation Dates of PLATO Exercises 
in BA 573 During Spring Semester 1972 



Date Implemented 

. ; \ ■ 

March 13, 14 
April LTV 
•May ir ' 
May IB 
June 1. 2 



Average Horn 
of Ihstytfgtion* 

.99 

^ .66 

.72 

1^3 



*Based on the average completion times for each exercise reported in.- Table 2. 

Exercise 1 requited an utiusual amount- of developpiient time « Probably 
five weeks of elapsed time occutred betwem the beginning o£ the development 
Of the exercise and its implementation. Even though the author was ex^ 
perienced in the use of computers and other pro gramMng languages, thete 
was a cortBiderable amoun^ of time required learning how. to use thef PLATO 
system and the TUTOR language t<o develop suitable Instructional material for 
BA 573. Referring to Table 7 it ^can 6e seen that exercises 3, 4, and 5 were 
each implemented ^about^ two weeks after the prior exercise was implemented. 
Thi^ basically reflects how much 'faster the author could ^develop kn jexerclse 
ORce he had the experience of developing two PLATO exercises^ behind hUm. 
Th,e best estimate of author development time required to dev^op PLATO 
exercises for this type of material can drawn from the results of 
exercise 5* It is estimated thSt the authoi^bent about 50 hdurs in the 
development of this exercise. Theref6re, at this stage in the author's 
experience with the PLATO system, since exercjse 5 provided 1.53 hotrs of i 

instruction, about 33 hours of development tlm^ were re(].uired to produce 

- « ,, ■ • . . • , ' 

1 hour of. instructional material for a PLATO exercise ^covering* a* relatively 
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compiezpypic in a technical course^ 

This estimate appfears realistic when 'compared to the avef^ge develop- 
ment time of .27 hours per hour of instructional material^ develo^Jed which 

quoted at the PLATO laboratory by staff personnel. It. appears that . ; ' ; - 
thisX^Sure was developed by asking all authors for a specified time < ^ , 

- ■ \ ■ . ' , 'V ' • - • ; • 

iperiod ta\report the development time required for their lessons. So, 

this figure w^ probably based on time^. reported by new. authors and very \ 

experienced authok^ alike for the development of everything from straightforward 

drill exercises; to the complex inquiry exercises over subject material which ^ 

varied greatly in its. technical content. These time estimates do not include 

the timeneces's^ry to propetiy document a PLATp exercise so that someone *else 

could understand or modify^the exe^bdjfe. 

' . .. . ' * • ..•'*'•■ 

* At this stage in its development, PLATO is considered to be. an experimental^ 

^ " ■ ' ■ ^ / - * ^' • •■ 

system so there are no charges incul^red directly for the use of the PLATO 

system. Therefore, the only real costs incurred in this period are those 

related t^b the time required fo,r an f^uthor to "develop exi^rcises for the 

. ..i/ ' ■ * ' i.^ , ' .■ • ' ■ 

PLATO system. Likewise ^ when the recurring costs for the^PLATO system are 

■ ; • ■ ■ , ' ^ - ' -t ' 

considered, no comment can be made about the charges for the use of the* 
PLATO system since no charges Were incurred for the Students in BA 573 who^ 
participated in the exercises at ^e PLATO laboratory in this research 
effortn^The oth^r major elemeijt of recurring costs, -the amount af an 
-^^author's time required to maintain^ developed exercises cailnot be eslPlinated ' 
either based on this researcTrV^^la^^^ can be^ 





identified. An author would be required to monitiSr^'eadari^afeg^^ of a PLATO 
exercise scheduled for students and make appropriate revisions tovthese . 
exercis^ based on ^sigrilficant developments in his field and the PLATO 
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"system. Thus, based specifically on this research^ef fort, Hot much 

' , . ' ' 'f- ' 

..... ^ .- 

information can be provided relevant to the direct costs associated Wit^ 

devjeloping and processing exercises on the PLATO system, 

^ However^ based on material published by the originators of the PLATO 

program, a- few comments can be made about the estimated operating costs 

.of PLATO III and-the projected operating costs of PLATO, IV. The coet 

projections f^r tLATO IV and the related costs for PLATO III. are based upon 

a unit of vil^wing time of instructional material a student contact hour. 

The individual elements of cost considered In^ these estimates are categorized 

into those associated with: < „ . 

. • • , .- J** , „ 

1. central computer facillt?y which pravicies the conuniflia cat ion control 

and data processing facility' for the system » 

2. Computer software system which supports the language in ,which 

■ ♦ ■ ■ - ■ ' . ; - ■■ ■ " ' • , ^ . 

instructional material is written. 

student^ console or terminal which provided the interface between 
the author or student and the computer ' . , * \ 

4. central Nnanagement services which are associated with the computer-^ 
based educational, system - , ■ 

communicatio^^^eh^nhels which carry the information between the 



computer and^ the individu al studen t^jterminal 
•6.- de^lopment of lesson material whiqh is to be ptes^nted on the 

computer-based educational system. 
Tlje costs of the current PLATO^lII system are not specified in detail, 
but it is suggested that thev operating costs of the PLATO III system witfTthe 
optimum number of 50 student terminals in use range from $1.90 to $2.90*- 
pe^r student contact hour. These- operatfng costs include charges for the 
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centtal computer facility, studei^t terminal and central management services. 

It;is estimated that the cost for the dexselopment o^lj^ software for trie 

PLATO III system shbuld. be allocated at an additional $.30 per student 

contact hour.^^-'iPKese costs for the PLATO III system ^re based on the assumption 

•* • » • , 

that t;he 50. student terminals will be tised 2000 hours per ye^r to provide 

about 100,000' student contact hours pfer year. 

;ThesiB costs ^hich it is^^estimat^^' are presently being incurred on the 

PLATOvIII system can be 'contrasted to the projected costs for the *PLAT(\ IV " 

system. The features of PLATO iV which enable the projected costs per 

student , con ta^ct hour to b^ significantly less are: " " 

X, the use of a large, third generation computer '.which c^n'service 

• • \ ■ " . . , ^ ^ 

up to 4000 Student teriitinals concurrently with several hundred . • 

different Wessons av^iTabl^e-foc^w^fe. at th^e same time 

2. the use of a lower cost student terminal with improved 'desfgn 

^ " ■ !■ ' •'^ \ , . • . « 

characteristics 

3/* the|'capability of serving student terminals at remote locations 
Mthin a 150 mile radius of the central computer facility at 
reascgiable .costs . • 
• T^us , the PLATO IV system is projected ^to have the capability to '>provide 
^^^S\?er -8,000,000 sfiidfent contact hXDurs oKuse perj year througKv4t^4000 
"Student terminals which each can^ptovide 2Q00 student contact hours of use 
pe^^^^^^This broader t^se of student contact hours over which c^ts can 



-be aTtecated anSnpf^^aK^^^^it costs of the hardware components of the 
PLATO IV sji^tem cause the projected operational cosf s'^S^aiUd^^^ contact 
houj^-for this^version of PLATO to^^ significantly lower than the estiraiated 
--operational costs^of^EATO III per student cbntac^^li^tl^ 8 has been 



37 



developed to ^ compare the estimated costs for the current PLATO III system 



and^ th^ planned FLAIG IV system. 
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TABLE 8 
* 

Summary of Es.tlmatad Operating Costs 
of PLATO III vs^PLATO IV 

(pej: student contact hour) ^ 

PLATO III 



Type of Cost > 

Central compiiter -facility 

Student 'terminal 

Cepitrar management services 

total of aboVS^operating costs 
Computer software sys£^^ 
Communication .channels^^^-— 

total q¥ all operating costs 



$1.90 to $2.90 

$ .30 

$0.01 

$2.21 to $3.21 



PLATO IV 

$0.11 > 

$0.18 to $0.50 
$0.03 

$0.32 to $0.64 
$0.01 

$0.01 to $0.03 
$0.34 to $0.68 



The dther major element of cost incurred In a computer-based educational 
'^system lis for the developmcmt of lesson material. It Is estimated that on 
the PLATO III system this' cost ^ has ranged form $400 to $800 per hour of 
'Instructional material prepared.' It is suggested that if the number of 

students who toQk a giverr one hour lesson Were 500 per ^ear for £lw years , 

.. / " ■ . ■* " ■ - 

th0CkU;hls cost could^ be prorated in terms of a cha^rge of about $.25 per , 
loUr of \tudetit use of the lesson. This type of charge could be applied 
^ a c^rse which ^^ulr^d 50 hours on the PLATO "system, pe^r semester' to ^ ' 
sug^st that a fee for thls^ course for using the PLATO system cQ^uldfkbe 
$12. 5Q* a ^ch^rge comparable to the cost of tiextbaok. It has been suggested; 
that thid. type of thinking can be extended to the PLATO IV system as a 
"^method to be considered for recovering the costs associated with thev ' ^ 
development of lesson material. ' . 

All c)f the above cost Ijiformation w&s extracted from ah« article written 

» • ■■ » ' • . " ^ « » . • 

by the originators of the PLATO program in orier \to provide the reader with 

^ ( ^ , ' ■ 

jthe flavor of the type of^ reasorfing whick has been done relative to determining 

■■■ ' ■ . ■ : . .■ ■ ■ ^- 



^ the^^^^^tr^^ of the PLATO system. The reaeavdcT^f^^^ 

the subject of this paper can* only • comment on this economic feasibij-ity to the' 

•» ■ * ■,,'.*■ ♦ • ' 

extent previously 'indicated. The reader is 'referred to lihe article referenced 
in this discussion of economic feasibility for the ^ detail dact a behind the 
quoted costs. ^ . . , 

♦ * The. benefits associated with the use of the PLATO system are the 

.. . - V ■ ' ■ ' ^ ■ - ■ ■ ■ ■'• ^ ^ ' ■ 

^ o£h^r matjpr aspect which must be considered to determine the economic ' * ^, 

• feasiW-lity of the PLATO system; l)uring this research, many of the potential 

• benef its* 0& .teaching material^rom an introductory ^course in operations . .: 

■ . . ^ ' . \\ * ' • " ' , ■' V . 

' research on nihe PLATO system were identified. The major benefits* which it *• - 

* '■ -. ■ ■;■ • ■■ . ''' ■■/ 

is believed wpuld be derived from implementing this type of material. on ^ 

• '-^ . ' • ' .. , • * • -V ■. ■ - ' ■ '■'""-■^^ : • 

th^ PLATO system are listed \>elow. They include:^ ' ^^ * , --^ • * *T 

» * . ' . •■ * ' • . ■ 

^ 1. .St;udent3 could learn certain subject material better. V 

' • . ^ J * ^ / 

2." Students- could learn certain material faster,, • V 

Students, could become more involved in the educational process 
and motivat^ed to perform better work, , ' 

4T- -&t«den4:^ could Jhaxiome-ffiore awajre af the capabilities of the cbmputer, 
' • . especially interactive computing. i, . /^.^ 

5. Students deficient in certain subject area^ .could be brought to ^ 
^ desired level of competence at their own pace. 

- /• \' . . V y ■ V.' , . " 

6i Instructional material could be presented to students Ip a" more 
. - consiaJ:ent manner. ' ^ . 

^ 7. PLATO* exercises could be modified more easily; than other, textual.. 

■ : -v^ ' ■ ' ' 

n^aterial could be revised. 

. .■ . ■ , 

Mos«t of these benefits would be^^^^J^f icult to Equant if y/biilK^n estimate q, 

lAlpert> D. > and D. Bitzer, Science, 167, 1582 (1970) . 
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required to t^ach specific subjec^^SatitexL^^In coi 
difficult to quantify the*" value of a benefit related tpTp^^ 
quality student. No atteitipt has been made to quantify the benefits wh 1x1 

. ■ ' ■ : I ■ : . ■ ^ . - 

were realized in the eHucatlonial process for course BA 573 as a result * 
of tMs reseafclu. Th^rfefore, to conclude- this section it should be stated 



that tnis report cannot comment objectively on the qi^estion of_the economic 
feasibility of ^the PLATO system, but has only presented information considerc 
relevant to thl^ question that uncovered during this resear<fh effort. 



Indirect benefits Realized 

An fmpottant secondary objective of this research WOT^o detem4ne|^w;pe 
a student's use of the PLATO system to leam operations research materie 
instills In him a greater appreciatipno for the use of the computer and /:he^ 

techniques of operations research in the problem-solving process.- The 

• • . * ■ ' ■ • 

capabilities of the computer were demonstrated to the student both directly 



atea to tr 
iop%a for 



an^d indirectly in the PLATO exercises develo>w for BA.^573". Routines were 
developed In the individual exercises which demonstrated- the computational 
power of the computer as well as the yalue of subroutines which could 
pierform iterations of calcu|.ations , ve^clior kultiplicatioi^ and all the 
-vector-n^^ calculations associated, with: a profit model. In the PLATO " 
exercises, the student was indirectly exposed to the capabilities of tl^e" 
computer when various types- of instructional material were presented and - 
various types oif response judging routines wei:e used which demonstrated the 
versatility of thi^ computer. In addition, each PLATO eicercise was built 
around a pi^obl(^m situation whic|;i the student participated in solving using 
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the techniques of op^Jfations research. • • 

Therefore, in the attitude survey wKich the students werje requested 
to complete on the last day of class iij BA 573, an attempt was made ta 

• . ■ \ r 1 • : . - / 

gain information aUout how valuable the students believed the techni^^es 
of oper^ytions research and thi computer^ j^oul^ be in solving problems in 
the ..business^ world. \ln additi^ivt^e attitude survey was designed to 
attempt to determiae^J^rfir educational experiences in BA 573 caused the 
students t^Jiave^these^opinions. Appendix E presents a suitoary of the 

commentV and rankings on these fsOrveys. The following remarks 




wiri attempt to* interpret their responses regarding the vi^lue of the . technique^ 
df operations research and the comj)u£6r ^' ^ 

Question 1 on the survey asked "Wh^t is yox^t opinion about the role 
the computer, will play -in your career as a manager?" The oombopite student 
ranking on the attitude scale provided for thi? question Was kpjiproximately 
midway betwe^ a composite gpihion of useful and very useful. pSurthermore, ^ 
sixteen^ of the nineteen students who provided written comments to this 
question indicated a high ^regard for the capabilities of the computer. 
The students' responses to question 2, "How do you foresee using the material 
taught in this cotirse in your resp6nsibilities as ''a manager?" sjiowed that 
27 of the 40 students commenting anticipated appljfjin^ tie material taught in 
BA 5Z3 constructively. Question 3 was ti|6ant to draw ouj: the student s 
Opinion about the combined use of the tools of the techniques of operations 
research>and the computer in problem solving. In this question, the student 
-was asked "What is your opinion about how valuable the techniques of 
operations research and the computer will be as problem solving tools in the 



business world?" Thq composite ranking on the attitude scale provided 
for this question was very close to a combined opinion midway betwj^en 
valuable and very valuable. Thf^refo^et it is assumed that* the students 

in BA 5739 in general » had a fairly high opinion for the computer and\the 

* • * . ' . \ 

techniques o{ operations research as probljsm solving tools at the concj^uslon 

of this tourae. 

In jiuestion 4 on the attitude survey » the student was asked whether hU 

attitude toward these problem solving tools h«Rl changed during hie coursework^ 

^ ' ^'^ / ' V 

in BA 573. In response to the question » "HoW have the leam^lng experiences 

in thls^^^ourse caused your regai^d for the computer and the te^nlques of 

oper^tlon^ reseairch to change from what it was before this course?" 24 

of^he 37 responses indicated that students now had a more enlightened attitude 

^^oward these tools after having completed* their courseworK in BA 573, In , ' 
^ * 
reference to these comments which reflected an attitude change » 21 students 

Indicated a more positive opinion about using the computer and the techniques 

of operations research f6r problem 8ol>^lng« Since moat of the students 

indicated a high reg^td for. these problem soling tools in prior questions,' 

it can be assumed that the thirteen studenlfs who commented that their ^ 

les^ming experiences la BA 573 changed their attitude toward these tools 

slightly, if at all, probably had a fairly good attitude regarding the use 

of th^ computer and the techniques of operations researcli before they entered 

BA 573. Therefore, it can be assumed that^the learning, experlenoies in 

BA 573 did cause some students to appreciate moxie the, uai^ of the capabilities 

of the computer and the technlLques of operations ^research- in the prpblem- 

~\ - * \ 

solving process. 
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<}u«0tlon 5 was detlghtd to dettrmlna what affect tha >^udant*8 ax^mrlanca 

4 

on tha PLATO ayatam had on hla formation of a mora favoratrla attitude 
toward theaa toola. Queatlon 5 aakad tha atudant, "To what extant haa your 
work on tha PLATO ayatam affected your attitude towarda tha uaa' of the 
computer and tha tachnlquea of oparatlona reaearch aa probleA aolvlng toola?** 
The compoalte measure on the attitude scale provided for thla queatlon 
Indicated that the uae of the P|[«ATO system affected the atudent*a a&tltude- 
« toward theaa toola favorably, In general* Appendix E ahowa that eleven of 

^ • thc^ fourteen atudenta whc/made wrltte^i comments to this question were very 

\ I . . \ 

\ \, complimentary to the PLATO type of teaching and found the *PLATO exerclpea 
to be helpful In making them aware of ^e capabilities of the computer and 
thfe tachnlquea of operations research. Thus, It appeara tha^ the 8utfject:ive 
evldenc;e tends to Indicate that a studefffc's participation In PLATO exercises 
devi^loped for an Introductory course *ln operations research does cause 
him to appreciate more the capab^llltles of the computer and the techniques 
of operatlona research in the- problem-solving process/ 
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Conclusion . y ^ . ^ 

The re^ultis of this research effort lndlc£ite , that it is technically, 
and operatlonaMy feasible to teach subject materlBl from an introductory 
course in operations research on the PLATO^ system, but that this type of 
teaching medium is not currently economically feasible. The Hardware at^ the 
software which* support the PLATO system jwere completely adequate for the 
development and presentation of instructional material. For the PLATO exercises 
developed In this projectV the subject students^^ppeared to ^ learn the material 
as well or better on the PLATO system and in lesser amount of time, in 



43 



\ 



gm^ral, than through the more fcradltlonal means of reading textual material 
and completli|^g homeWbrk aaalgnmenta. Furthermore, the majority of the students 
who participated In PI^AXO exercises expressed ^he opinion that they believed 

a computer«»based educational system was an effective teaching medium and 

■ ■ * > 

that this type of Instruction should be continued and increased In the 

4 

Introductory cpurse In operations research. 

Although the economic feasibility bf this type of instructional medium 
was not proven » there are several considerations which should be evaluated 
when the future potential of computer-based educational systems Is being 
Investigated. . 

* '1« The hardware and software supporting these systems Is being Improved 

If . ' 

continually to provide Inst rue t'lonal systems with Improved operating 
characteristics afid lower imlt operating costs« 

o 4 

"^*"^2« Instructional material developed for thesjB systems has the potentl 



for widespread usage which would reduce' the unit developmental costs. 

9 

\ ■ V 

3. The student who participates In this type of educational system 
Is receiving a beneficial educational Experience by functioning In 
an Interactive computer Environment. 

4. The unit costs associated with the more traditional educational 
media have been exhibiting a steady growth trend. 

$^ce It Is believed that the potential exists to apply the capabilities 
of the modem digital computer to upgrade the educational process In^^ , 
economic manner » it is recommended that research to determine the feasibility 
of ^computer-based educational systems be continued. ^ The major objective of . 



^Atkinson* C. R4» and H. A. Wilson , Editors , Computer-Assisted Instruction - 
A Book of Readings , Academic Press, Inc., New York City, New York, 1969. 
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future research in this area should! be to. develop the addltii^al Inlormatlon 
required to answer fully the question of the feasibility of this medium 
of instruction. However, another important objective o£, this research should 
be to explore further the characteristics of computer-ba^ed educational 
syatems to more completely understand and evaluate the educational strategies 
and technique^^ossible with this type of medium. * « 

In summary , the' attributes of computer-based educational systems which 
wdjre identified in this research project were: f 

1. capability to accommodate students with a wide variety of 'individual 
ability levels and learning styles through highly Individualized 
instructional sequences which are eltt^er student controlled or 
based upon an spalysis of the student's past p^formance 

2. provision of an educational environment which enhances the learning 
- process by enabling a student ^ to l\acpme more actively involved in. 

the educational process, to have^his responses evaluated dh' a 
real-time basis , ^nd to Work at his cw4 pac^ in relative privacy^ 

3. ability to provide ins truest ional materiltl from session to session 



\ 

\ 



on a more consistent basis in terms of lesson content than an 



individual instrucTtor could or different instructors could 
4\ provision of an opportunity for students to become aware of the 
capabilities of the computer and to develop a positive attitude 
^egarding the use of computers in a modern society ' 
5. provision fpr students to use the computationaCl power of the 

computer during a lesson and for authors to .use' the data. handling 

capabilities of the computer to collet data during a lesion to 

\ ^ ' * ■ i , 

\ • ■ ■ ^ 

analyze the per:^ormance of students and the effectiveness , of the ^lesson 
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6. ability to provide a student ^with the. ddportunlt^ to explore 
, ' a problem situation and discover answers £pr himde^ in an unst:ructured 

inquiry type of environment^ - , 

7. capability ^to provide a student /With ^the opportunity to\p(press 
his feelings about a learning experience at the time when tHeae 
feelings occur by enteflng appropriate information into t'he sy^:em 

X . ■ .. . • ■ - ' " - 

8. capability to record a student's responses during a lesson and the , 

.1 • ' 

". • » 

|i0itential to analyze the* pattern of liis responses to provide , 

significant information about the student *s learning process, « V ^' 

* problem-solving process and decisioq.-maklng process 

9. ability to easily modify a lesson to" improve it so that it will 

' ■* ■ « .1 ' *" 

_ — ,t * 

affect all studentfs ixKcomijarieon, to the means avaULable to modify 

^ A. 1 • . . ■ • V 

"^other types of instructional material * \ 

10. capability to provide a vide variety of visual instructional material 
and related audio' mat^ial during' a lesson ' , . ' * ' 

11. ability to handle ^ wide variety of teaching tasks and, thus, 
provide instructors with the opportunity to do more meaningful work. 

^ As indicated, these characteristics of computer-based "^educational systemsi. ' 
should be evaluated to determine ^hich aspects of this, medium are mor^ 
ef/icient and/or effective than the attributes of the more traditional media 
of instruction. To facilitate this type of evaluation, future research with 
computer-based educational systems should be documented better in terms or the> 
principles utilized in preparing the instructional material to )>e presented, 
the educational strategies and technic^uea, used to implement lesson material, 
and the specific results attained through the lis e of this medium< This 
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kind of proposed evaluation implies that the attributes of the more traditional 



educational media shoiild be better understood and more capable of measurement, 

^Iko. Moreover, a related objective of future research with computer-based 

educational syatetn^ should be to discover^how best to integrate this medium 

into the instructional process with the traditional media to improve the 

overall educational process. ^ ^ 

■ ... * .-^ • / 

To conclude this report, it should be stated thalC computer-based educa«- 

tiopal systems appear to have the capability to imptbve.the educational 

process^ the major advantages which it is believed could be realised . 

through the use of this type of educational system are: 

1. a mqre efficient, educational medium with attend0Jit-'^:ev{er unit ' 

'developmental and operatingj^ga&ts''3ependent primarily up oh the: 

nece&sary^eGhirlcal improvements in such systetns arid^the widespread 

; usage of instructional material developed \ '\ 

li. a more effective education^^inedium whereby situdent achievement and 

performance is improved in learning and' applying subject ^i^terial 

• 3. a more versatile educational medium in terms of the type of student 

who can be accommodatejj^ the type oC subject material which can be 

presented and the setting in wl>ich the learning experience can be ^ 

accomplished / , ^ . 

4. ' a better understanding of^ the learning process based upbn the 

collection and analysis of the student responses provided by a 

* . computer-oriented rnstlructional system. ♦ * ^ s ^ 

Thus, tomputer-baseif etluc|it systems seem ^t^^ave the potential to 

revolutionize the educational process. /"A&Hth^*modern digital computer,*" whicih 

provides the capabilities for this type of 'instructional laedium^sjias ^ 



r^Volutlbnleed the field of data processing, so can this method of presenting 

. i . 

Subject mat-erlal Impact on the field of education. Computer**ba8ed educational 
sys terns . can provide the opportunity to enhance the educational process by ^ 
presenting Instructional material In a more effective » versatile and efficient 
manner and by providing the meaiis to gain aijdltlonal Insight Into, the 
learning ptoces^s. ' V • , 



Appendix A " 

Summary of Comments from Questionnaires 
for piiATO Exercise 1' 



Typical Comi^ients 



Students Commeriting 



Do you have any suggestions to improve this specific exercise? 



allow more Jtime 

make questions clearer 

explain keyset better 

make answer judging more flexible 

allow mote use of ANS key 



8 
2 
1 
1 
1 



* * * * 



What i^ your impression of this type of teaching prpcedurei^here you . 

intefict with a' computer-based system such a^ PLATO through a terminal? 

*#..'-.." * 



excellent teaching procedure * 
great, outstanding, very impressed 
Interesting, fun, enjoyed ^it 
gcod supplementary e>:erclse 
liiufts way to answer- questions ^ • 
prefer reading a good text 
prefer to h:4ve a good instructor 
had a feeling o^ ^an machine 



5 
6 
7 
5 
1 
.1 
1 
1 



How do you believe\ the PLATO system can best be. utilized to teach th-e 
material usually presented in an introductory operations research cou^e? 



.supplement lectures . - ' ^ _ 
reinforce basic concepts * ^ 

for examples and homework probleiris 
teach FORTRAN and l:(.near programming 
make students be more explicit V 

^ ■ 
* * * * 



5 
5 
5 
3 
1 




In what way has this exercise served to clarify or reinforce the .material' 

• currently being taught in BA 573? ' 

clarifies course material and direction ^ , ^ ^ ^ 

presents good examples of use of matter ial in real world 5 

good review of linear algebra 3 

.helped me to understand vectors • ' 1 . 
computer interaction made' me understand computers better 1 . 

exercise was a novelty ■ > ■ • ,1 
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\ ..... ; : ^ ' ,' ; . . . , 

Typfical Comments * . . Students Commianting 

Do you have any additional comments or suggestions regarding the 
development o£ a compute r-ba^^d operations research course? 

mechanize calculations 2* 

furnish written material before the exercise 2 ^ * 

develop more operations research material 2 

furtilsh a cppy of lesson material after exercise l^ 







* : ■ 
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• " . ■ * '■ 
Summary of Comments - from C 


• ■ ■ . 

luestlonnalres v 





for PLATO Exercise 2 

^ , ■ 

Comments which related to liow this lesson or future lessons mi.Kht be ^ 
improved: 

^ ' . , - /; 

■ * . ■* ■ . " , 

1. clearly indicate when computations should be performed 
. manually and the result entered into the system 

' .* ' ■ ' • 

2. Introduce the use of the PLATO system better 

3. use the computational capabilities of the ihachMe .more 

4. try using multiple choice ^questlonsVc^ , • 

5. deveibp harder problems * 

6* don't compliment .the student when his answer is correct;; 

7. some questions were ambiguous 



Comments which/ related to the student 's impression of this' type of 
teaching procedure: ^ ' ' 

1. very valuable method * ^ ' 

r . ■ 

♦ ■ • • • 

2. good possibilities 

3. effective teaching procedure (two students) 
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^ _ • • • , * • 1 , ■. , . 

\ A. I like it since it's easier to l?am concepts tl^is way , 

• 5. impressions are^e^nt*irely posltive-^ince I like to learn at py 
own speed and to have imtaediate feedback 

6. impressive and more interesting than conventional type of homework 

7/ good because of feedb£|ck to answers (two students) 

8.. good method and would cause me to learn faster because of 
immediate feedback on ^^rrors^ ^ ^ * 

9. 1 don't lik^ it because it is 'frustrating to have to guQss what 

answer is acceptable . " ■ » • ' 

'■ ' • ■ ■ • ■ . . ■ ■ ■ ; . . i ... : ■ 



Coinments relevant to the value of the cqntinued use of t\i€ PLATO system 
in teaching material in an introductory course in operations rese^ch: 

^,1.' use for houjework problems (five stud^nts)^ 

2. use to teach modeling, vector algebra and a problem solving 
approach ^( three students) ^\ • 

t ' ■ . • • 

3. use to perform' computations 

^ '4« use to reinforce concepts taug^tj in clas^ and make them -clearer 
* 5«' - use to solve problems illusttating concepts 
' 6. use to test studeiits . 



V * * Appendix C ' « 

Summary of Gomments from Questionnaires ' 
for PLATO Exercise 3^ 

Co|ranei\ts which ^related to how thi^ lessor or future lessons might be improved! 

; ' ■ ' * , ' \ ' ., • y.- 

*1. provide more instructions on the forms of correct answers which 
/ are considered acceptable « x-^^ 




2. provide more instruction on how to get intoTTub routines 



3. /indicate s'pedifxcally when word answers aije required and -when 
tiumferic answe^rs are required ' 
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4. prQv/de class lectures on iJkte^^^H to be Covered by a PLATO 
ledson and then reqiiire related^ homework to be completed after 



a' TLATO session .'"^ 



5. develop more complex fQllow-up problems. \ i 



6. make the lessons more difficult and challenging 

■ " ■■■ - V ' ' ■ ' 

7. provide more than one assistant to answer questions during, a 

PLATO exercise 



Comments which related to the studen^^'s Impression of this type of teaching 
procedure: , v. ^ » . 

V' ' . ■ ' ' ■ \-' ■ ' 

1. like It very much" \ ^ 

/2. iquch- better than claSsTtoom discussion ^ 

3. interesting and enjoyable learning experience 

4. ^ -gain satisfaction from completing, an exercise 

like real time grading of your answer 

• * * • '. • ■ * 

- 6. like the subroutine '^o multiply vectors- - ^ 

• 7/ O.K., if it fits into the coUrse \ 

8. prqtess interesting, but cato only a<5,t as a review of material 
taught in class 

9. am concerned about the consequences of exposing a graduate student 
^ to this system . 

10. very frustrating, typing answers is tedious 

11, prefer class 

0 ■ ■ 

^ % ■ . - 

Comments relevant to the value b£ the continued use of the PLATO system 
in teaching material in an introd'uctojry course iti\ operations Research: . 

11 reinforce basic concepts of linear algebra^ (five students) 

■ ■ N,^ ' , •• • ' , y ' ' 

2. solving homework problems (tht^e students) 

-» \^ • ' ■ / . ■ 

3. teadk new and more difficult concepts 
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I , Summary of Comments from Questionnaires 

for PLATO Exercise 4 • / 

" ■ ■ ■ h ■ - ■'- :. 

Com)[nent3 which related to how this lesson or future lessons might be improved: 

1. provide addi^tional written material for: the lesson tp facilitate 
understanding 'it 

2. provide for more extensive review *of prior material in the lesson 
whetinthe student requests it V ^ 

3. provide the written material for theXledson to the sttfilent for his 
review prior to the' lesson ^ 

4. make, the questions ^less vague and the hints as to the correct ^ x 
answers clearer 

5. provide the acceptable answer 'for a question to the student 
automatically, afte^ he responds Incorrectly a certaip ntpber of 
times " \ , 

Comments whiph related to the \student 's impression of this type of teaching 
pjToc-edure: \ . 

1. impressed,^ can be very helpful jand practical * . 

2. thoroughly enjoyed it ^ 

3. .much'^asier to follow than class presentations 

4. bel^ve in audio-visual teaching procedures and would like to 

take tnore tests of this nature " • 

■ . '? . 

I , 5. much greater personal involvement and greater demai^ids placed- on 
! * my learning ' , ^ ^ 

6. it is' a viable idea ' . 

7^/ tedious, but wpuld be very worthwhile the first couple of 
w§4ks of the course 

* < ^ 

8. * not as frustrating since this was my second exerciseV with even 

more familiarity it could become much more efficient and fun • 

9. fair, like having an average instructor / 
10. exercise was O.K., but sometimes it got down to man vs. machine 
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Comments rele^nt to the\alue of the continued us^ of the PLATO system 
in teaching m^erial in an\introductory coursje in operations research: 

1. supplement and reinforce tasic course material (six students) 

Z. act as a means to integrate course material' 

, ^ V - *' " , . ■■ ^ 

3. help to solve problems , 

4. tackle all areas of the course r 

5. provide the step^by-step solution of classic pperablo^' research 
problems ■•'-'^■•i / • , ■ ^ | 

6. provide a student intermittent feedback on ptpgress In tl^^ course 
provided now only by tests , 

7. have PLi^TO classes in basic areas before classroom instruction, 
then have similar lessons after classroom instri;iQtiQn ^as feedback 
for prpgress analysis - ' i 
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/Summary of Comments and Rankings from the Attitude Surveys 

1^ What is you^ opinion about the role the. computer will play in your 
career ^s a manager? ^ 



Typical Comments 



immensely tiseful tool 
great deal 
Important role 

key tp doing better business 
bi|| sjpporting role A 
ever Increasing role \\ 
lavAeit depending on company 
faikly important role 
not used much in management in India 
don,*t know 
the less^ the better 



NumDer 
Commenting 




3 
3 
>3 
2 
1 
1 
1 
2 
1 
1 
1 



Total, commenting 



19 
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^ei^lx E— Coittlhued 
Sunnnary Attitude Sci||Le £pr the Above Question 



\ 



13 \ ^ . 

2 2111 XI'. 



X5 



not useful 



^sHghtly useful 



useful 



very useful 



2* How do you foresee\ using the material taugfit iiK this course *lh your ' 



respoTlslbllitles as a manager? 



Typical Comments 

provide a ba^lc understanding of; the/area| ^\ 
perform reasV^nable problem solving 
problem formulation ' 
^conce^t construction , 
control "^nd recordkeeping 
Aon't know \ / • 

not much ^ 

Total,, commenting V 



. 'Number 
Commenting 

' 16 
. 5 
^ 3 

1 

2 

12' 




3. What Is yoiir opinion about how valuable the techniques of operations 

research and the computer will be as; problem solving ^tools In the- business 
world? ' * " ' ' 



Typical Comments 

lU) oth^r efficient way' 
computer will be excellent 
may\ be valuable ^ 

^ Total commenting 



Number 
Commenting 

L 

- ^1 ^ 
,1 



} 



Suiitmary Attitude Scale for the Above Ques 



tiof?^ 



\ 



19 



13 





— H 


H 





























hot valuable 



slightly valuable 



valuable 



very valuable 



4. 



. \ " • • * • ■ 

^ Appendix E~^Contlnued * , 

How have the learning experiences In this cburee caused your*, regard 
for' the computer and the tedml<|[Ui^s of operations research to, change* 
from what It was before this course? 





Nuaber 


Typical Coonents 


Coomentlnft 


realize how valuable' they are now 


6 


understand th^OK better 


5 


place value on them now 


7 " 


more Interested now 


2 


see them more I^b tools now 


1 


noi^ realist their Imperfections \ • ^ 


3 - 


slightly. If at all 




\ 

Total commenting 


"IT 



t 

I 



\i ;To what extent has your vorU the PLAT6 System affected your attitude 

towards the use of the computer and^the techniques of 9i)|lratlons 
J research as pjcoblem solving tools? •n • 



Ty pi c al ^ Ciommen 1 6 



/ 



PI.ATO Vas very helpful , ^ 

PLATO was- excellent ^ ^ 

work on/PLAl[0 was vety uoeful 

PLATO lias' helped me see their relationships 

uslnk PLATQ was fun and ^effective 

dldi^t use! PLATO enough/ 

use PLATO ^8 much as possible as a tool to 

learn operations research 
the more exercises, the better 
changed from attitude of frustration and 

worthlessness tp feeling of val&e 
Improved attitude toward the computer some 
not at all 
Indifferent 

PLATO was too picky on answers 
Total commenting 



* Nuniber^ 
(Commegting 

1 
1 

r X 
1 

2 . 
1 

1 

1 

:i 
1 
1 

1 
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56 
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Sujasary Attitude Scale for the Above Queiti^on 



unfavorably slightly -favorable favora|yly •^Veiry favorably 

6. Vfhat teaching techniques used In this- course h^ye been the most; effective 



In your opinion? 



Nunber , 

Typical Comments Commenting 

PLATO • 

computer work . 7 

class problems X. 6 

graded homework * 2 / 

PLATO homework problems ' , Z 

quizzes ^ . /2 - 

direct problem solving o ^ 

availability of outside aselst^ce 1 

working with the Instructor in his office 1 ^ 

lectures 1 

self study ^ 1 



total commenting '42 

7. What recommendations would you make for using PLATO type Instruction 
. 'In future BA 573 courses? 



/ 




Number 

Typical CjMfllgents . ^ Commenting 

Increase Its use * iA 

use it right from tfie beginning of the course 6 

problem solving 4 

continue to us^b it 3 

as much ^8 possible 3 

supplement lectures .3 

basic concepts , 3 

qufz preparation and quizzes ^ 2 

definitions > 2 

extend its use to more complex concepts ^1 

application of theory / \ . 1 



^**ContlnMd 



Number 

Typical Comments * Commenting 

Introduce student to use of computer 
make It a programmed learning course 
none \ 
drop It . 
prefer an Instructor 
needs more Improvement 
allow more time In an exercise 
coordinate with class lectux^ better 
make keyboard Insttfuc^lons better 
loake programming mo^e flexible 

Total commenting ^ 

8. What Is your general In^resslon of the PLA^O system as a teaching 
technique? 

Ntunber ' 

Typical Comments / \ Commenting 



helped me considerably 
very Impressed 
excellent teaching method ' 
>]fery useful 

llke^lts Immediate feedback 

has much potential, use l^^to solve harder problems 
very worthwhile If lntegr£^ted with classroom Instructions 
learned more from It xthon Iplass^oom Instructions 
Interesting exercise \ 
provided help^fitl^^teachU^g 

valuable, but could be improved ^ , 
could be good, can also be very frustrating 
O.K. for some courses 

by requiring the exercise, you force the student to 

do some studying 
another method of exposure s ^ 
you can guess your way through the exercise 
prefer a good text to rieference 

Total commenting 17 

Summary^of Attitude Scale for the/Above Question 




"mm 



111 



16 



unfavorable 



slightly favorable ^ , 



favor^le,; 




very favorable 



